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Abstract. Let p be a polynomial in the non-commuting variables (a, x) = 
(ai , . . . , flg^ , , . . . , Xg^ ) . If p is convex in the variables x, then p has degree 
two in X and moreover, p has the form 

p = L + A^A, 

where L has degree at most one in x and A is a (column) vector which is 
linear in x, so that A^A is a both sum of squares and homogeneous of degree 
two. Of course the converse is true also. Further results involving various 
convexity hypotheses on the x and a variables separately are presented. 



1. Introduction 

Fix a positive integer g and let a = (ai, . . . , ttg) and x = (xi, . . . , Xg) denote 
two classes of non- commuting variables which are assumed to be symmetric 
in the sense explained below, and let M(a, x) denote the polynomials in these 
variables. Thus an element of M(a, x) is an M-linear combination of words built 
from a and x. 

There is a natural involution ^ on M(a, x) which reverses the order of a word 
determined by 

ifgf = c/f 

for f,g& M(a, x) and 

T _ T _ 

for j = l,2,...,g. 

If the polynomial L(a, x) has degree at most one in x and if A(a, x) is a 
(column) vector which is linear in x, then the polynomial 

p = L(a, x) + A(a, x)'^A{a, x) 

is convex in x, since, for each fixed a, 

^(p(a, x) + p{a, y)) - p{a, ^-^) = A(a, ^^-^fA{a, ^^—^)- 

The converse is a corollary of the main results of this paper. We remark that 
it was already shown in |HL] that if a symmetric polynomial is convex in x, 
then it must have degree two or less in x. 
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In the remainder of this introduction we introduce the terminology and 
background necessary to state our main resuhs on the structure of polynomials 
which satisfy various convexity hypotheses. The exposition is restricted to the 
case where both the a and x variables are symmetric, but, for the most part, 
the results go through with the obvious modifications to the situation where 
some of the variables are symmetric and others are not. A notable example 
where a convex polynomial arises is the Ricatti inequality, 

^ -h^x^b + a^xa + c, 

where X IS cL symmetric unknown and a, 6, c are not necessarily symmetric 
knowns. 

Of course there is no need to assume that the number Qa of a variables is the 
same as the number of x variables, but it does simplify the exposition. The 
interested reader should have no problem in refining various estimates which 
depend upon g in the case where Qai^dx- 

1.1. Non-commutative polynomials. A non-commutative polynomial, or 
simply polynomial, q in g non-commuting variables y = [yi, . . . ,yg) is a M- 
linear combination of words in the letters y = {yi, . . . ,yg). Thus 

q = ^qwW, 

where the sum is finite, the w^s are words, and G M. 

There is a natural involution on words in y which reverses the order of 
the product. Namely, 

(1) ?/ji%2 ■■■yj„ = w^w'^ = yj^ ■ ■ ■ yj.yj, . 

This involution naturally extends to polynomials by linearity, 

g = 2^ qwW , 

and a polynomial p is symmetric ii p = p^. As noted before, the conventions 
here mean that yJ = yj and so in this sense the variables themselves are 
symmetric. 

Polynomials are naturally evaluated at g'-tuples of symmetric matrices. Let 
E>n denote the symmetric nxn matrices with real entries and let S„(M^) denote 
g tuples Y = (Yi, . . . , Yg) where each Yj G §„. There is no requirement that 
the Yj commute. Given the word w from equation ([1]), 

wiY) = Y- = Y,,Y,,...Y,„ 

as expected, and of course, 

g(y) = 5^g^F-. 

Note that the involution on polynomials is compatible with the transpose 
operation on matrices so that q{Y)'^ = g-^(y). In particular, if p is symmetric, 
then so is p(Y). 
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1.2. Convexity. A symmetric polynomials p is convex provided 

(2) [tp{Y) + (1 - t)p{Z)] - p{tY + (1 - t)Z) y 

for all n, all pairs Y, Z & S„(]R^) and < t < 1. Here P y means the square 
matrix P is positive semi-definite in the sense that P = P^ and all of its 
eigenvalues are non-negative. 

Even in one variable {g = 1) convexity in this non-commutative setting is 
different from ordinary convexity since there is no requirement that Y and Z 
commute. Indeed, the polynomial p{y) = y"^ in the single variable y is not 
convex (for a simple example where convexity fails for this p see |HM04] ) . 

The notion of convexity for a polynomial naturally extends to partial con- 
vexity; i.e., convexity in a subset of the variables. 

1.3. Domains and Convexity. It is natural to consider polynomials which 
are assumed convex only on a subset; i.e., where the inequality of equation 
[2] is to hold only for some choices of pairs Y and Z. As a preliminary, it is 
necessary to discuss non- commutative domains or domains for short. 

Let S(R^) denote the sequence (S„(M^))„. A non-commutative domain I) in 
S(R^) is a sequence V = where each Vn C S„(M^) which is dosed under 

direct sums in the sense that if Dj G Sn^iR^), then Di Q) D2 E Sm+n^iM^)- 

1.3.1. Non- commutative domains. The domain V is open if is open in 
S„(]R^) for each n; it is convex if each is convex; and it is matrix con- 
vex if for any isometry : ]R"i IR"^ ^nd D = {Xi,...,Xg) G V^^, 
V^DV = (y^XiV, . . . , V^XgV) G Vni', the domain is semi- algebraic if there 
is a finite set V of symmetric polynomials such that Vn = {X G S„(]R^) : 
p{X) y 0, for all p G V}. 

Below are several examples which are presented to illustrate the ideas or 
because they will play a role in the sequel. 

Example 1.1. The e-neighborhood of 0. Given e the sequence of sets, 

A^„ = {XG§„(M^):5^X|^eJ„} 
is an open matrix convex semi-algebraic domain. 

Example 1.2. Products. If W, V C S(]R^) are domains, then so is the product 

U xV={UnX Vn)n C S{W X W). 

The conditions, open, convex, matrix-convex, and semi- algebraic, are all 
preserved under products. 

Example 1.3. Coordinate Projections. Given a domain W C E>{W x W), 
let 

T^aO^n) = {Ae : there exists X G §„(M») such that {A,X) G >V„}. 

The coordinate projection tTq preserves open, convex, and matrix convex do- 
mains. 
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1.3.2. Partial convex domains. Many of the notions surrounding domains have 
partial versions; i.e., versions apphed to a subset of the variables. For instance, 
a domain W in S(R^ x M^) is open in x if for each n and {A, X) G VV„ there 
is an open subset U of Sri(IR^) containing X such that {A} x U C Wn- 

In general, matrix convex implies convex (this depends upon the closed with 
respect to direct sums hypothesis). It turns out that if V is semi-algebraic, 
then convex implies matrix convex so that these two notions agree. 

1.3.3. Partial Convexity. A polynomial p{a, x) is convex in x on the open in 
X domain W if for each n and {A, X), {A, Y) G Wn such that t{A, X) + (1 - 
t){A, Y) e Wn for each < t < 1, it follows that 

tp{A, X) + tp{A, Y) h p{A, tX + {l- t)Y). 

1.3.4. Main Convexity Results. This subsection contains most of the main 
results on partially convex polynomials. 

Theorem 1.4. Let W = be an open domain in S(M^). If p{a,x) is 

convex in x on W, then 

p{a, x) = L{a, x) + V{a, x)"^ Z{a)V{a, x), 

where 

(i) Z{a) is a (square) matrix-valued symmetric polynomial; 

(ii) zlA)yO for each A e 7r„(W); 

(iii) V{a,x) is a (column) vector whose entries are linear in x; and 

(iv) L{a,x) is a symmetric polynomials with degree at most one in x. 

It follows that p{a, x) is convex in x on the product domain TCaiW) x §(R^"=) 
and has degree at most two in x. 

Proof. See Corollary 13.61 □ 

If Z{A) y for all A, then, by a result in [M], Z factors as Z = R^R for a 
matrix- valued polynomial R giving the following variant of Theorem II. 4[ 

Theorem 1.5. Suppose p{a, x) is a symmetric polynomial andU = {Un)n is an 
open domain in S(]R^). Ifp{a,x) is convex on the product domain S(]R^) x U, 
then 

p{a, x) = L{a^ x) + A(a, x)^A{a, x), 

where 

(i) A{a,x) is a (column) vector and is linear in x; and 

(ii) L{a,x) has degree at most one in x. 

Consequently, p has degree at most two in x and is globally convex in x. 

The previous theorem can be used to deduce the structure of polynomials 
p{a, x) which are either convex or concave in each variable separately. 
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Theorem 1.6. Suppose p{a, x) is symmetric. If p is convex in x and concave 
in a, then there exists linear (homogeneous of degree one) polynomials rj{x) 
and Si{a) and a polynomial L{a,x) which has degree one in both x and a (so 
joint degree at most two) such that 

p{a, x) = L{a, x) + R{x)'^R{x) — S{a)'^S{a), 

where R{x) is the (column) vector with entries rj{x) and likewise for S{a). 

Proof. See Theorem 15 .![ □ 

Theorem 1.7. Ifp{a,x) is (globally) convex in a and x separately, then there 
exists a polynomial L{a,x) and and a (column) vector of polynomials A{a,x) 
which has degree at most one in x and a separately (thus at most degree two 
jointly) such that 

p{a, x) = L{a, x) + A(a, x)^A{a, x). 

Here A(a, x) is a column vector so that A(a, x)'^A{a, x) = ^ Aj{a, x)'^Aj{a, x) 
is a sum of squares. 

Proof. See Theorem 14. 1[ □ 

Remark 1.8. The converse to each of the theorems in this subsubsection is 
evidently true. 

1.4. Positivity of the Hessian. Just as in the classical commutative case, 
for a (non- commutative) symmetric polynomial, convexity implies that the 
Hessian - a version of the second derivative - is positive semi-definite. Con- 
versely, a variety of fairly weak positivity hypotheses on the Hessian impose 
very strong restrictions on the polynomial. 

1.4.1. Definition of the Partial Hessian. Let p{a,x) be a given symmetric 
polynomial. The partial Hessian of p with respect to x in the direction 
h = {hi, ... , kg) is the formal second derivative of the polynomial in t, p(t) = 
p{a, X + th). Thus, the partial Hessian, 

^pia,x)[h]=p"{0) 

is a polynomial in 3g variables and is homogeneous of degree two in h. 

This partial Hessian can also be described algebraically on a monomial 
m{a, x) by replacing each pair of variables Xj and x^ with hj and hj. respectively 
and then multiplying by two. In particular, the partial Hessian of monomials 
of degree zero or one in x is 0; and the partial Hessian of a monomial of degree 
two in X is simply that monomial multiplied by 2 with x replaced by h. 

A simple observation, which will be used repeatedly without further com- 
ment, is that if p{a, x) has degree two in x then ■^p{a, x)[h] depends only on 
x and h and moreover there is a polynomial L{a, x) of degree at most one in 
X so that 

1 ^2 

(3) p{a,x) = -—p{a,x)[x]+ L{a,x). 



6 HAY, HELTON, LIM, AND MCCULLOUGH 

Moreover, this representation is unique in the sense that the Hessian is the 
part of p{a, x) which is homogeneous of degree two in x and L{a, x) contains 
the remaining part of p. In particular, there can be no cancellation between 
these two terms. 

Examples will be given in Section I2.1[ 

1.4.2. Convexity and the Hessian. The following Proposition says that con- 
vexity of p on an open in x domain V implies positivity of the partial Hessian 
on V. 

Proposition 1.9. Suppose p{a,x) is a symmetric polynomial, A G S„(M^), 
andU is an open convex set in §„(M^). If p{A,X) is convex for X ElA, then, 
for each X eU and H e S„(M^^), 

^piAX)[H]yo. 

Explicitly, the hypothesis on p is that for the given A and each X,Y E U, 
and < t < 1, 

p{A, tX + {l- t)Y) ^ tp{A, X) + {1- t)p{A, Y). 

Proof Fix X eU. For a given H G S„(M^) and s G M small, X ±sH eU. 
By the convexity hypothesis on p, 

^ (piA, X + sH)+ piA, X-sH))- 2p{A, X) = s^g^piA, X) [H] + o(/) . 

Dividing by and letting s tend to gives the result. □ 

Positivity of the Hessian not only implies convexity of p, but also imposes 
further serious constraints. 

Theorem 1.10. Suppose p{a,x) is a symmetric polynomial of degree da and 
dx > 2 in a and x respectively and W C §(M^ x W) is a domain. If 



(i) W is open in a; and 

[A 



(ii) for each n and each {A,X) G Wn and every H G S„(]R^), 



■p{A,X)[H]^Q, 



dx"^ 
then, either 

(A) there is a nonzero polynomial q of degree at most da and dx — 2 in a 
and X respectively, so that q{A, X) = on W; or 

(B) p has degree at most two in x, and for each A G vTaCWn), the function 
p{A,X) is (globally) convex in X & §„(]R^). 

In particular, ifW is the product W = S(]R^) x V, for some matrix convex 
set V = {Vn)n, then either 

{A') there is a polynomial q of degree at most da and dx — 2 in a and x 
respectively so that q{A, X) = for all {A, X) G W; or 
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[B') there exists A{a,x), linear in x, and L{a,x) a polynomial of degree at 
most one in x so that 

p{a, x) = L(a, x) + A(a, x)'^A(a, x). 

Proof. See Section [31 □ 

Proposition 13.11 which isolates the role of positivity of the Hessian, is a not 
too technical, but still widely applicable, ingredient in the proof of Theorem 

inoi 

1.5. Further Results and Organization of the Paper. The proofs of the 
main results turn on the border vector-middle matrix representation of the 
partial Hessian. This representation and some examples are discussed in the 
next section. Section [21 

The proofs of Proposition 13.11 Theorem 11.101 and Corollaries thereof are in 
Section [31 The proofs of the results in Subsubsection 11.3.41 are in Sections [H 
and [51 

A structure result for the middle matrix of the partial Hessian which is of 
independent interest and will likely be a valuable tool in further investigations 
is presented in Section [61 which can be read following Section [2l 

2. The Middle Matrix of the Partial Hessian 

A polynomial q{a,x)[h] in the non-commuting variables a,x and h which 
is homogeneous of degree two in h is conveniently represented in terms of a 
Gram-type representation in the form 

q{a,x)[h] = V{a, x)[h]'^ Z{a, x)V{a, x)[h], 

where Z{a,x) is a symmetric matrix with polynomial entries, and V{a,x)[h] 
is a vector, called the border vector, whose entries have the form hjm{a, x) 
for monomials m of degree at most the degree of q in (a, x) . Thus, we can 
index the entries of Z := Z{a,x) by the monomials hjm{a,x). The notation 
Z{-,-) will be used to denote the matrix Z, as well as the entries of Z. For 
example, Z{hjm{a, x), h^m^a, x)) denotes the entry of Z, corresponding to 
entries hjm{a, x) and hkm'{a, x) of the border vector. Context will make clear 
which of the two uses of the Z{-, ■) notation is being employed. 

The matrix Z = Z{a, x) is known as the middle matrix and is unique up 
to order and presence of zero rows and columns. When q is symmetric, so is 
Z{a, x). 

Of special interest is the case that p{a,x) is symmetric and q{a,x)[h] = 
-^p{a, x)[h]. A central object in the analysis to follow is the derived middle 
matrix, 

Z{a) = Z{a,0). 

Suppose p{a, x) is a polynomial of degree in x and da in a. Let Z be the 
middle matrix for the partial Hessian of p. We take the border vector for Z 
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to be of the form 



V 



where Vj is a vector whose entries consist of words of the form 

KmoXk^mi ■ ■ ■ mj^iXk^rrij, 

where mo, . . . ,mj are words in a such that deg„ mo + • • • + deg„ ruj < da- 
That is, Vj captures those monomials in x and a of total degree at most da in 
a and degree exactly j m. x. Thus Vj is a vector of height 



N. 



3 ■' 




^no+-+nj+i 



and Z has [d^ — 2)(Nq + ■ ■ ■ + Nd^_2) rows and columns. With respect to this 
block form of V , we can write Z in block form Z = [Zij], for i, j = 1, . . . , d,j. — 2. 
Thus, Zij is that part of Z which corresponds to terms the part of the border 
vector on the left and the part on the right. 

2.1. A few simple examples. 

Example 2.1. Let p — ax^a. Then q{a,x)[h] — 2[ahxha + ah^xa + axh^a], 
which is equal to 



[2 h ah xh axh xah ] 




0x010 

10 






h 




ha 




hx 




hxa 




hax 



Example 2.2. The polynomial p = ax^ + x^a has Hessian 2[ahxh + ah'^x + 
axh^ + hxha + h'^xa + xh"^] which has the representation 



[ h ah xh axh xah ] 2 





" 


X 





1 


" 




h 




X 





1 










ha 


2 





1 













hx 




1 
















hxa 





















hax 



Example 2.3. Let p = x'^ax + xax^ . Then q{a,x)[h] — 2[hxah + h^ax + 
xhah + haxh + xah^ + hahx], which equals 



[ h ah xh axh xah ] 2 



xa + ax a 1 




a 

1 















h 




ha 




hx 




hxa 




hax 
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Recall that Zqq is that part of the middle matrix which corresponds to those 
terms of the border vector with no x variables (both sides). Thus, in this last 
example we have 

xa + ax 




^00 



and likewise 



and the derived matrix is 



^01 



a 




Z = Z(0,a) = 2 








a 1 



a 



1 



2.2. Faithfulness. The following standard Lemma says more than the total- 
ity of matrix evaluations are faithful on M(a, x). Given g and d, let 

d 

(4) N{9,d) = J29'- 



Lemma 2.4. Suppose p{y) is a polynomial of degree d in g variables. If p 
vanishes on an open subset U C Siv(g,d)(IR^); then p = 0. 

Proof See Lemma 2.2 in |HM04j . □ 



3. The Structure of Partially Convex Polynomials 

In this section we consider positivity conditions on the partial Hessian of a 
symmetric polynomial p which impose strong constraints on the form of p. 

We begin with a result which isolates the role of direct sums and positivity 
of the Hessian. 

Proposition 3.1. Let p = p{a,x) be a given symmetric polynomial of degree 
da and d^ in a and x respectively. Suppose n > N{g,d), v G M", and that U 
is an open set in §„(M^). // 

(i) the set {m{A,x)v : deg^ m < d^ — 2 and deg^ m < da} is linearly 
independent in for each A G U ; and 

(ii) for each natural number i and A E U, 

< ig^PiA ®h,x® h) [H]v, v) 
for all H G Sn^iM^-), 

then 

(a) the degree of p in x is at most two; 
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(b) the partial Hessian of p takes the form 

^p{a,x)[h] = {Via)[h]fZo,oia)Via)[h]; 

(c) Zo,o{A) hOforAe U; and 

(d) there is a symmetric polynomial L{a, x) which has degree at most one 
in X so that 

p{a,x) = -V{a)[x]'^ ZQfi{a)V{a)[x] +L{a,x). 

In particular, p{A, X) is (globally) convex in X E S„(M^) for each fixed 
AeU. 

Proof. The partial Hessian can be represented in terms of the middle matrix 

Z{a, x) as 

——^p{a,x)[h] = V{a, x)[h]'^ Z(a, x)V{a, x)[h]. 

OX'' 

Given i, let [v]£ denote the vector in M"^ = (M")^ with each of its £ block (of 
length n) entries equal to v. Since the set {m{A ® h^x® h)[v\i '■ deg^ m < 
dx — 2 and deg„ m < da} is linearly independent, the |CHSY] Lemma implies 
that the subspace {V{A ® h.x® h)[H][v\i : H G iS„£(M^^)} has codimension 
at most K, in W^^'^dA independent of n. (See the appendix, [|8]for the details.) 
Choose £ so that k < i. With this fixed £, to simplify the notations, let 
A = A^ le] X = X® If, and v = [v]i. 

It follows that Z{A, x) has at most k < £ negative eigenvalues for each 
A E U. We now partition V{a^x)[h] and Z{a,x) in blocks by the degree 
of X and let Zji{a,x) denote the part of Z{a,x) corresponding to the terms 
of degree j and / in x. In particular, Zo,d^_2(a,x) represents those terms in 
the Hessian of the form mi{a)h^s{a,x)h^mr{a,x), where mr{a,x) has degree 
dx — 2 in X and where mr,mi,s are monomials. (Here we are assuming the 
degree in x is d^, if it is lower, make the obvious adjustments). It follows that 
Zo,d^-2iO',x) = Zo,d^_2(a) is independent of x. 

Now Zo,d^_2(a) is a matrix with polynomial in a entries. Since n > N{g, d) 
and U is an open subset of SAr(g^d)(M^''), it follows from Lemma 12.41 that 
Zo,d^-2{A) 7^ for some (and hence most) A E U. Thus, Zo,d^_2(^) has 
rank at least £. Hence, from the form of Z, if dx — 2 > 0, then Z{A, x) has at 
least £ negative eigenvalues, contradicting k < £. We conclude that dx < 2. 

Now that we know the degree of p is two in x, the middle matrix Z{a, x) = 
Zoola). Which gives the advertised representation. 

For the last part of the theorem, we argue as above and find that Z{A) = 
Zofl{A) = Z{A)®Ii has at most k < £ negative eigenvalues. From tensor prod- 
uct form it follows that Z{A) can have no negative eigenvalues as otherwise 
Z{A) has at least £. Thus Z{A) >z 0. 

Since Z{A) y and (since p has degree at most two in x), 
p{a, x) = V{a) [x]'^ Z {a)V (a) [x] + L{a, x) 
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it follows that, with A fixed, that p{a, x) is convex in X G S„(M^). □ 

Remark 3.2. As seen in the proof, in item (ii) the for every £ can be replaced 
with some £ > k + 1 where k is an integer which depends only upon d and g. 

In view of the remark and the following Lemma, Hypothesis (ii) of Theorem 
13.11 is stronger than needed in that it suffices to tensor with for certain £, 
thereby weakening the need to tensor with Ii at all. 

Lemma 3.3. (R. Guralnick and L. Small) Let q ^ be a given (not necessarily 
symmetric) polynomial of degree d in g variables. Then there is a sequence of 
integers Uk oo for which 

{A G §„, (M^) : q{A) has full rank } 

is open and dense in §n^(]R^). 

See Appendix [9] for a proof. Likely, the special sequence can be replaced 
by: any n > uq for some hq depending only upon g and d. 

The proof of Theorem 11.101 combines Proposition 13. II and the following two 
lemmas. 

Lemma 3.4. Suppose W C S„(M^ x M^) is a domain and da and d^ are natural 
numbers. Either there exists an n and (A, X) G Wn and v G MJ^ such that the 
set {m{A, X)v : m is a monomial with deg^ m < d^ — 2, deg^ m < da} is 
linear independent, or there is a polynomial q (not necessarily symmetric) of 
degree at most da and dx in a and x respectively so that q{A, X) = for all 
{A,X) G W. 

Proof. A proof can be found in [DHM06] [Lemma 4.1]. □ 

This Lemma naturally combines with the following simple observation. 

Lemma 3.5. Suppose W C S„(M^ x M^) is a domain and and natural numbers 
da and d^ are given. If there exists n and (A, X) G W and f G M" such 
that {m{A., X)v : m is a monomial with deg^ rn < d^ — 2, dega m < da} is 
linearly independent, then for each {B,Y) G W and vector w (of the correct 
size), the set {m{A Q) B,X Q) Y){v ® w) : m is a monomial with deg^ m < 
dx — 2, dega ^ ^a} ^■^ linearly independent. 

Proof of Proposition \1.1(A From Lemma 13.41 either there is a (not necessarily 
symmetric) polynomial q of degree at most da and dx — 2 in a and x respectively 
so that q{A,X) = on W, or there is an n, a pair {B,Y) G W„ and vector 
M G M" so that the set {m{B,Y)u : deg^, m < dx — 2 and deg„ m < da} is 
linearly independent. 

Given {C,Z) G W, let {A',x) = {B ® C,Y ® X) e W and v = ® u. 
By Lemma 13.51 the set {m{A', X)v : deg^, m < dx — 2 and deg^ m < da} is 
linearly independent. In particular, by the open in a hypothesis on W, there is 
a neighborhood U of A' such that for all A E U the set {m{A, X)v : deg^. m < 
dx — 2 and deg^ m < da} is linearly independent. Since W is also a domain on 
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which the Hessian is non-negative, Theorem 13.11 apphes with the conclusion 
that p has degree at most two in x and 

p{a, x) = -V{a)[x]'^ Z{a)V{a)[x] + L(a, x), 

where L{a, x) has degree at most one in x, and Z{A) y ioi A & U. In 
particular, Z{B®C) >z 0. Therefore Z{C) >z andp(C, X) is convex (globally) 
in X for each C G 7ia{W). 

For the second part of the corollary, note that in the absence of the polyno- 
mial q, the first part of the corollary implies that Z{A) >z for all A. Thus, 
by a Theorem in ^J, Z{A) factors as a SoS and the result follows. □ 

We close this section by pointing out the following simple special cases of 
Proposition ll.lOi 

Corollary 3.6. If p{a, x) is convex in x on an open domain W C §(M^ x M^), 
then 

p{a, x) = L{a, x) + V{a, x)^ Z{a)V{a, x), 

where 

(i) Z{A)hOforAeTTa{W); 

(ii) V{a, x) is the border vector, which is linear in x; and 

(iii) L{a,x) has degree at most one in x. 

Proof. Note that Lemma 12.41 rules out the possibility that there is a nonzero 
polynomial q such that q{A, X) = for all {A, X) G W. The convexity implies 
that ^p{A, X)yO for all (A, X) in the open domain W. Consequently, the 
conclusion of the Lemma follows from the argument given for the proof of 
Proposition ILlOi □ 

Corollary 3.7. Suppose V C S(M^) is an open matrix convex set and let 
W = S(]R^) X V. Ifp{a,x) is convex in x on W, then 

p{a, x) = L{a, x) + A(a, x)'^A{a, x), 

where 

(i) A(a, x) is a vector and is linear in x; and 

(ii) L{a, x) has degree at most one in x. 

Proof. As in the previous corollary, there does not exist a nonzero polynomial 
q such that q{A, X) = for all {A, X) e W. Thus, option {B') of Proposition 
ILIOI occurs. □ 

4. Separate Convexity 

Theorem 4.1. Ifp is (globally) convex in a and x separately, then there exists 
an m and polynomials L{a, x) and Aj{a, x), j = 1,2, ... ,m, which are degree 
(at most) one in x and a separately (thus at most degree two jointly) such that 

p{a, x) = L{a, x) + A(a, x)'^A{a, x). 

Here we have used the shorthand, A{a,x)^A{a,x) = ^ Aj(a, x)"^Aj(a, x). 
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We begin with a lemma. 

Lemma 4.2. Suppose p{a,x) = q{a,x) + 

(i) each rj{a, x) is homogeneous of degree one in x; 

(ii) q{a, x) is degree one in x; and 

(iii) p{a, x) has degree at most two in a, 

then each rj{a,x) has degree at most one in a and q{a,x) has degree at most 
two in a. 

Proof. Terms from q{a, x) cannot cancel those from s{a, 2;) = X] ''^ji^^^ x)^rj{a, x), 
since the former are of at most degree one in x and the later homogeneous of 
degree two in x. Since p has degree two in a and there can't be cancellation 
of the highest degree term in a in the sum of squares term s, each rj{a, x) has 
degree at most one in a. Likewise, q{a, x) has degree at most two in a. □ 

Let denote those monomials in x and a which are linear in each of x and 
a separately. Thus J' has 2g'^ elements. Let V{a, x) denote the tautological 
vector whose entries are the monomials from J'. Given & J ^ J matrix M, 
the expression, 

(5) s(a, x) = y (a, xY MV{a^ x) = Mm,£m{a, x)i{a, x) 

is then a polynomial which is homogeneous of degree two in each of x and a 
separately. 

If M = R^R, then 

(6) s{a,x) = 'y^^rj{a,x)'^rj{a,x) 

where rj{a, x) = RjV{a, x) and Rj is the j-th row of R. 

Conversely, if s has the form in equation and rj = 'Y^rj{m)m{a.,x) 
(where the sum is over m E J), then s has the form in equation ([5] with 
M = R^R, where R is the matrix whose j-th row has entries Rj{m) = rj{m). 

Lemma 4.3. Suppose s{a, x) is homogeneous of degree two in each of x and 
a separately. If A and A' are nx J' and n' x J' matrices respectively such that 

s{a,x) = V{a,xfA'^AV{a,x) = V{a,xf{A'fA'V{a,x), 

then there is a partial isometry U : M" M"' such that A = UA' . 

Proof. It is readily verified that 

(7) A^A = (A'fA'. 

The existence of U now follows from the Douglas Lemma. For convenience of 
the reader we give the argument in this case. Define U on the range of A into 
the range of A' by UAm = A'm (here m is the vector with a 1 in the m-th 
place and elsewhere). The equality ([7]) implies U unitary and thus extends 
to a partial isometry (by defining it to be on the orthogonal complement of 
the range oi A). □ 
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Similarly, a polynomial p{x) which homogeneous of degree two in x alone 
(no a) can be represented as 

p{x) = V{xfPV{x), 

where V{x) is now the vector with entries xj. The polynomial p is a sum of 
squares if and only if P = R^R for some R (so if and only if P is positive 
semi-definite). In particular, we are using V in two different ways which should 
cause no confusion. 

Proof of Theorem \4.1\ Since p is convex in x, Corollary 11.51 implies p can be 
written in the form, 

p{a, x) = L(a, x) + H(a, x)^E(a, x), 

where E{a,x) is linear in x and L{a,x) has degree at most one in x. Here H is 
a vector with entries Hj . 

Since p is convex in a it has degree at most two in a. Thus, Lemma 14.21 says 
H(a, x) has degree at most one in a and L(a, x) has degree at most two in a, in 
addition to the degree restrictions relative to x above. 

Write Hj (a, x) = aj{a, x) + bj{x) with ) homogeneous of degree one in 

a and bj [x) a polynomial in x alone. Similarly, since L has degree at most one 
in X and two in a, it can be written as 

L(a, x) = C(a, x) + D{a) + E{a, x) 

where C{a,x) is homogeneous of degree two in a and one in x; D{a,x) is 
homogeneous of degree two in a (and has no x); and E has degree at most one 
in each of x and a. 

Now let A and B respectively denote matrices which produce the represen- 
tations 

"^ajaj =V{a,x)'^A^AV{a,x) 
J^bjbj =V{x)B^BV{x). 

We have, 

p{a, x) =V{a, xfA^AV{a, x) + [V{a, x)A'^BV{x) + V{xfB^AV{a, x)] 
+ C(a, x) + V{x)B^BV{x) + D{a) + E{a, x). 

Note that the term [■] is the part of p{a, x) which is homogeneous of degree 
two in X and one in a; whereas C{a, x) is the part homogeneous of degree one 
in X and two in a. 

Reversing the roles of x and a, p can also be written as 

p{a,x) =V{a,xf{A'fA'V{a,x) + [V{a,x){A'fB'V{a) + V{af{B'fA'V{a,x)] 

+ C"(a, x) + V{a){B'fB'V{a) + D'{x) + E'{a, x). 

Note that the term [■] is the part of p{a, x) which is homogeneous of degree 
two in a and one in x; whereas C'{a, x) is the part homogeneous of degree one 
in a and two in x. 
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Comparing these last two representations we find, 

V{a, x)A^AV{a, x) =V{a, x){A'fA'V{a, x) 
V{a,x)A^BV{x) + V{xfB^AV{a,x) =C'{a,x) 
V{a, x){AYB'V{a) + V{af{B'fA'V{a, x) =C{a, x) 

V{af{B'fB'V{a) =D{a). 

From Lemma [4.31 there is a partial isometry U so that A' = UA. Choose W 
so that / - f/f/^ = WW^. Consider, 

{AV{a, x) + BV{x) + U^B'V{a)f{AV{a, x) + BV{x) + U^B'{a)V{a)) 
+ {WB'V{a)f{WB'V{a)) 

- [V{af{B'fUBV{x) + V{xfB^U^B'V{a)] + E{a,x) 
= {AV{a, x) + BV{x)f{AV{a, x) + BV{x)) 

+ V{a, xfA^U^B'V{a) + V{af {B'fUAV{a, x) 

+ V{afB^UU^BV{a) + V{af {B'fW^W B'V{a) 
= {AV{a, x) + BV{x)f{AV{a, x) + BV{x)) 

+ [V{a, xf{A'fB'V{a) + V{af{B'fA'V{a, x)] 

+ V{afB'^BV{a)+E{a,x) 
= {AV{a, x) + BV{x)f{AV{a, x) + BV{x)) + C{a, x) + D{a) + E{a, x) 
= p{a,x). 

□ 

5. Convex in x and Concave in a 

Theorem 5.1. Suppose p{a, x) is symmetric. If p is convex in x and concave 
in a, then there exists linear (homogeneous of degree one) polynomials rj{x) 
and Si{a) and a polynomial L{a,x) which has degree one in both x and a (so 
joint degree at most two) such that 

p{a^ x) = L{a, x) + R{x)'^R{x) — S{a)'^S{a), 

where R{x)'^R{x) and S{a)'^S{a) are shorthand for the sums 
and Sj{a)^ Sj{a) respectively. 

Proof. Since p is (globally) convex in x, it can be written in the form, 

p{a, x) = A(a, x)"^A(a, x) + L{a, x), 

where A is linear in x and L{a, x) has degree at most one in x. Thus, 
A(a, x)^A{a, x) is homogeneous of degree two in x; whereas L(a, x) had degree 
at most one in x. In particular, there can be no cancellation between these 
terms. 

Since p is (globally) concave in a, it has degree at most two in a and since the 
terms in A{a,x)^A{a,x) can not cancel with those in L{a,x), it thus follows 
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that A(a, x) has degree at most one in a and hkewise L{a, x) has degree at 
most two in a. 

Write, 

L(a, x) = Lq{x) + Li{a, x) + L2{a, x), 
where Lj is homogeneous of degree j in a (and degree at most one in x). 
Similarly, write A(a,x) = Aq{x) +Ai{a,x), with Aj homogeneous of degree j 
in a. 

Taking the partial Hessian of p with respect to a gives. 



-p(a, 2;)[A;] = 2[Ai(A;, x) Ai(A;, x) + -L2(A;, x). 



Since ^p(a, x)[A;] is negative semi-definite (in k for each (a,x)), and since 
the first term above is homogeneous of degree two in k while the second has 
degree at most one in /c, it follows that Ai(A;,x) = and L2{k,x) is negative 
semi-definite. Since L2{k, x) has degree at most one in x and is negative semi- 
definite, it does not depend on x; L2(a,x) = L2{a). Further, L2{a) is negative 
semi-definite and hence can be written as —S{a)^S{a). □ 

We anticipate that many of the results in this section and the last section 
will localize as the following theorem illustrates. By ||a|| < 1 we mean the 
open matrix convex domain with {{A G : X] < ^n})n C §(Mf ). 

Theorem 5.2. Suppose p{a,x) is symmetric. If 

(i) p{a,x) is convex in x for \\a\\ < 1; 

(ii) p{a,x) >: for \\A\\ < 1 and all X; and 

(iii) p is concave in a, 

then p has the form, 

p{a,x) = W{xf{R{a) - Q{a))W{x), 

where 

(a) W{x) is the vector with g + 1 entries the monomials {0, xi, . . . , x^}; 

(b) R{a) and Q{a) are symmetric matrix polynomials in a; 

(c) R{a) has degree at most one in a; 

(d) Q{a) is homogeneous of degree two and Q{A) >z for every A (and so 
Q{a) is a sum of squares); and 

(e) R{A)~Q{A)yOfor \\A\\<1. 

Note that the converse is true too; i.e., if p has the form above and (a)-(e) 
are satisfied, then p satisfies (i)-(iii). 

Proof. The convexity in x and concavity in a are enough to imply that p has 
degree at most two in each of x and a (so at most degree four). Further, by 
convexity in X for ||v4|| < 1, it follows from Corollary 13.61 that 

p(a,x) = ]^V{a)[xY' Z{a)V{a)[x\ + L{a,x), 

where Z{A) >z for ||y4|| < 1 and y(x)[/i] is the border vector (with respect 
to x) for p{x, a), which is linear in x (homogeneous of degree one) and L{a, x) 
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has degree at most one in x. In particular, by considering the differing degrees 
of the X terms, there can be no cancellation between the two terms. Because 
of this lack of cancellation, both terms have degree at most two in a. 

Represent y(x)[a] = Vo{x) Q)Vi{x)[a] and decompose Z with respect to this 
direct sum as 




Note that Mu is constant, Moi(a) has degree at most one, and Moo(a) has 
degree at most two. Since Z{A) ^ for ||y4|| < 1, it follows that Mu ^ 0. 

We now take the Hessian of p with respect to a, 
-— p(a,x)[^] = V{x)[kf ^ ^^^[ J J ^(,)[,] + o^.Lixm. 

Replacing x with tx, choosing t large, and using the hypothesis that p{a, x) is 
concave m a, so that ^p{A,X)[K] < for all choices of X,A,K it follows 
that the first term above is negative semidefinite; i.e., 

v(xm- ^«.[fi) v(xm i 

for all X, A, K. Thus, by Lemma 18.31 (really it may first be necessary to take 
direct sums), the matrix 

(M'^,[K] M',,[K]\ 
\M[,[K] Mu J 

is negative definite and, therefore, Mu ^ 0. However, as noted above, Mu h. 
0, and thus Mu = 0. 

Since Z{A) >z for < 1 and Mu = 0, it follows that Mqi = 0, too. We 
conclude that p has the form, 

(8) p{a,x) = V{xfZ{a)V{x) + L{a,x), 

where V{x) is the vector with entries {xi, . . . , Xg}; Z{a) (is a matrix and has) 
degree at most two; Z{A) >z for ||y4|| < 1; and L{a,x) has degree at most 
two in a and at most one in x. 

Coming at things from the other way, the fact that p{a, x) is concave (glob- 
ally)in a (for each x) implies that 

(9) p{a, x) = — A(a, x)'^A(a, x) + M(a, x), 

where A(a, x) is linear in a and M{a, x) has degree at most one in a. As usual, 
the fact that p also has degree at most two in x implies that A (a, x) has degree 
at most one in x and M(a, x) has degree at most two in x. 

Comparing the representations of equations ([H]) and (jH]) with an eye toward 
the terms which are homogeneous of degree two in each of a and x, it fol- 
lows that A{a,x) is a linear combination of terms of the form aj and ajXe. 
Consequently, there is a matrix- valued Q{a) so that 

A{a,xfA{a,x) = W{xfQ{a)W{x), 
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where Q{a) is a sum of squares, and W{x) is the vector (of polynomials) 
defined in the statement of the Theorem with entries {0, Xi, . . . , Xg}. 

From equation ([HD, p{a,x) does not contain monomials of the form XjXkttg 
(or ttiXkXj). Hence, M{a,x) can be written as 

M{a,x) = W{xfR{a)W{x), 

where R{a) has degree at most one. Thus, 

p{a,x) = W{xf{R{a) - Q{a))W{x), 

where R,Q satisfy the conditions (a) - (d). 

To complete the proof we need to show R{a) — Q{a) >z for ||a|| < 1. 
For a given n, the set 



{W{X)v 



( ^ \ 

\XgvJ 



is dense in M*^^"*"^)". To prove this claim we follow the route of the CHSY- 
Lemma (see Appendix [H]) . Suppose first that v = ei and let 



w 



be given. Letting 



X, 



Wj2 







so that Xj = Xj and XjCi = Wj, it follows that 



D W{X)e, 



It follows that F„ contains all vectors of the form. 



)(g+l)n 



for which wq ^ and the claim follows. 

Finally, since p{A,X) y for ||yl|| < 1 and all X, if ||A|| < 1 andX G 
and V G M", then 







< p{A,X)v,v) = HQiA) - P{A))W{X)v,W{X)v). 
From the density of r„ it follows that Q{A) - P{A) ^0 □ 
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6. The Polynomial Congruence 

In this section we establish a polynomial congruence between Z{a, x) and 
2(a) (the derived matrix, Z{a) = Z{a,0)) in the case that Z{a,x) is the 
middle matrix of the partial Hessian of a symmetric polynomial p{a,x). The 
relation is analogous to that found in [DHM07] 

Suppose p{a, x) is a polynomial of degree dx in x and da in a. The partial 
Hessian of p can be written as a sum of terms of the form mLkLfhnmR, where 
r = Z{mLhL,hiimji), and rriL and m^j are monomials in x and a. We use 
{rrLLhi, huniii) to index these terms. We will further write rriL (and similarly 
m/j) in the form 

Xi^mi,^ ■ ■ -Xi^rrii,, 

where each nii^ is a monomial in a alone. So in particular, here ttil has degree 
i in X. 

Let Z = [Zij] be the middle matrix for the partial Hessian of p. Here the 
block structure indicated by Zij is determined by the the degree in x of the 
monomials in the middle matrix per the usual convention. 

For each j = 0, . . . , d^ — 2, let Kj be the Nj x Nj_i matrix with entries 

Kj{hk^+2'n^k,+2Xkj+irnk^+i ■ ■ ■ Xk^mk^^hk^^^rUk^^^Xk^ ■ ■ -Xk^nikJ = Xk^^^ruk^^^^ 

and all others being 0. 

Lemma 6.1. Let p he a polynomial of degree dx > 2 in x and of arbitrary 
degree in a. Let Z = [Zij] be the middle matrix for the Hessian of p. Then 
Zij+iKj + Zij{a, 0) = Zij for i = 0, . . . ,dx — 2, and j = 0, . . . , dx — 3, where 
i + j < dx - 2. 

Proof. It suffices to prove the result for monomials, since it is evidently linear. 
Thus, suppose i + j < dx — 2 and the monomial 

xe^rrn^ ■ ■ ■ xe,mi^he^^,rhk^^2^kj+2Xk,+imk^+i ■ ■ ■ Xk^ruk^ 

is the (x^^m^i ■ ■ ■ xe^rriiMi^^^, hkj+2'^kj+2Xkj+^mk^+-, ■ ■ ■ Xk^rukj-tevm of the Hes- 
sian (so this is an entry of Zij^i). Then the 

[xe^rrii^ ■ ■ ■ Xi.me.he^^^, hkj+-,mk^^^Xk^ ■ ■ ■ Xk^rukJ 

term will be 

xe^mg^ ■ ■ ■ Xi^mi,Ai^^^rXk^^2^k,+2f^k,+i'mk^+iXk^ ■ ■■Xk^mk^. 
In other words, Zij{xg^mi,^ ■ ■ ■ Xemi^hi^^-,, hkj+-,mkj^-,Xk^ ■ ■ ■ Xk^ruk^) equals 
Zij+i{xi^mi^ ■ ■ ■Xe^mi^hi^_^-^,hk^^2i^kj+2Xk,+i'rnkj+i ■ ■ ■ Xk^'mkJxk^^2^kj+2- 

Now, the {xi^mi^ ■ ■ ■ Xe^me^hg^^^, hk^^-^mk^^^Xk^ ■ ■ ■ Xk^nikJ-entij of Zij+iKj 
is the product of row 

xe^me^ ■ ■ -Xi^mi^hi^^^ 

of Zij^i and column 

hk,+irnk^+iXkj ■ ■ -Xk^ruk-^ 
of Kj. The only nonzero entry of column hk^^j^mk^^j^Xk^rnkj ■ ■ ■ Xk^ruk^ of Kj 
is Kj{hk^^2i^kj+2Xk,+i'mk^+i ■ ■ ■ Xk^mk^,hk^^^mk^^^Xk^ ■ ■ ■ Xk^ruk,) = Xk^^2^kj+2- 
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Hence, the {xe^me^ ■ ■ ■ xi^mi^he^^^, hk^^^nik^^j^Xk^ ■ ■ ■ Xfe^m^J-entry of Zij+iKj 



IS 

Zij+i{xi^mi^ ■ ■ ■xe^mi^hi^^^me^^^,hk^^2mk^^2Xk^^irnk^^i ■ ■ ■ Xfc^mfcjxfc^.^jmfc.^j, 
which equals 

Zij{xe^mi^ ■ ■ ■ xi^rrii^hi^^^, hk^^^mk^^-^Xk^ ■ ■ ■ Xk^nik^). 

We conclude that Zij^iKj + Zij{0) = Zij whenever i + j < ~ 2. 

If i + j = dx — 2, then Zij+i = and Zij = Zij{a, 0), so that Zij^iKj + 
Zij{a, 0) = Zij. Clearly the result also holds when i + j > dx — 2. □ 



To illustrate, in Example 12.31 note that Zoo(a.,x) = Zoi{a, x)Ki + Zoo(0,a) 
where 



X 

xa 



Theorem 6.2. There is a matrix polynomial A{a, x) so that 

Z{a,x)A{a,x) = Z{a,0). 

Further, A has a square root B, so that = A, which is also a polynomial 
for which 

B'^{a,x)Z{a,x)B(a,x) = Z(a,0). 

Further, B is invertible (and its inverse is a polynomial). In particular, for 
any {A,X) e §(M^ x Rf), B{A,X) is invertible. 



With Lemma [6.11 in place, the proof of Theorem 16.21 follows along the lines 
of the proof of Theorem 7.3 in |DHM07] . Let A{a, x) denote the matrix 



(10) 



A{a, x) 



I 

-Ko I 
-Ki 

























I 



and observe Z{a,x)A[a,x) = Z(a,0) follows from Lemma l6.ll For B(a,x) 
one takes 



dx—2 

B{a,x) ■.= J2(']iAia,x)-iy 
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7. Signatures 

Since the partial Hessian, -^p{a, x) [h] , of the symmetric polynomial p is 
symmetric, it has a sum of difference of squares (SDS) decomposition, 

—p{a,x)[h] = ^qj{a,x)[h]qj{a,x)[h] -^rj{a,x)[h]r(,{a,x)[h], 
^ i=i e=i 

where qj,re are linear in h. 

The minimum number of positive (resp. negative) squares needed in such 
a decomposition is the positive (resp. negative) signature of ^p{a, x)[h], de- 
noted a±{-^p{a, x)[h]). More generally, any symmetric polynomial q{a,x)[h] 
which is homogeneous of degree two in h has a SDS decomposition (again with 
factors qj,r£ linear in h). Accordingly, we may define the signature (J±{q). 

For a symmetric matrix polynomial Z{y) in y and Y G §„(]R^) we let 
fi±{Z{Y)) denote the number of positive or negative eigenvalues of the sym- 
metric matrix Z{Y). 

The following proposition is a generalization of a result from [DHM07] . 

Proposition 7.1. Let q{a,x)[h] be a symmetric polynomial in no variables 
(a, x,h) = (tti, . . . , ttg, Xi, . . . , Xg, hi, ... , hg) that is of degree £ in x and homo- 
geneous of degree two in h with middle matrix Z{a,x). Then 

fii{Z{A,X))<nai{q) 

for each n and (A,X) m §„(Rf x W). 

Proof. Suppose 

cr_l_ cr_ 

g(a, x) [h] = fffj - gjgj, 
i=i i=i 

where the fj and ge are linear in h, is a SDS decomposition with the minimum 
number of positive squares. Then 

fJ {a, x)[h]fj{a, x)[h] = V{a, x)[h]^ Fj{a, x)V{a, x)[h] 

and 

gj (a, x)[h]gj(a, x)[h] = V{a, x)[h]'^Gj{a, x)V{a, x)[h] , 

where each of the matrix polynomials Fj{a,x) and Gj{a,x) on the right is of 
the form 

Fj{a,x) = $j(a, x)$j(a, x)"^ and Gj{a,x) = '^j{a,x)'^{a,x)^ , 

for vectors $j and whose entries are polynomials of degree less than or 
equal to £ and the border vector V{a,x)[h] is linear in h. 

Since 

q{a, x)[h] = V{a, x)[h]'^{ Fj{a, x) — Gj{a, x) )V{a, x)[h], 
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and for a given q the middle matrix is unique, once the border vector is fixed, 
it follows that 

Z(a, x) = Fj{a, x) — Gj{a, x). 
i=i i=i 

Since the rank of Fj{A,X) is at most n, it follows that Z{A,X) has at most 
y^fjmm positive eigenvalues. □ 

Corollary 7.2. Suppose q is the partial Hessian of a symmetric polynomial 
of degree dx > 3 in x . If a±{q) < 1 , then 

(i) = 1; 



sup i : A G §.(M^) H a±(g). 



n 



Proof. If a^{q) = 0, then q is the negative of a sum of squares, so that earlier 
results then imply that the degree of p is two. Thus, cr+(g) = 1. In this case, 
in view of the previous proposition, it suffices to prove that there is an n and 
an A G Sn{W) such that fi+{Z{A,0)) > n. The Zo,d,_2(a,x) = Zo,d,_2(a,0) 
block of the middle matrix of the Hessian of p is not zero. It therefore has an 
entry (NC polynomial) which is not zero and therefore, by the Guralnick-Small 
Lemma (Lemma l3.3p . there is an n and an A G S„(R^) so that ZQ ii-2{A, 0) has 
rank at least n. Since the middle matrix is symmetric and upper anti-diagonal 
and the upper right has rank n, it has at least n positive eigenvalues (Corollary 
5.4 in |DHM07j l This gives item (n). □ 

Conjecture 7.3. Suppose q is the partial Hessian of a symmetric polynomial. 
Then 



sup 

n 



n 



A G §„,( 



8. Appendix A. The [CHSY] Lemma 

At the root of the [CHSYj Lemma is the following 

Lemma 8.1. Fix n > d. If {zi, . . . ,Z(i} is a linearly independent set in 
then the codimension of 



IS 



d{d-l) 



(Hz,\ 

HZ2 

\HzJ 

In particular, this codimension is independent of n. 




Proof. Consider the mapping <I> given by 



3 



fHz,\ 

HZ2 

\HzJ 
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Since the span of {zi, . . . , z^} has dimension d, it follows that the kernel of $ 
has dimension k = ("~'^)(^~'^+^) and hence the range has dimension ^^'^^^^ — 
To see this assertion, it suffices to assume that the span of {zi, . . . , Zd} is the 
span of {ei, . . . , e^} C M" (the first d standard basis vectors in M"') in which 
case H is symmetric and Hzj = for all j if and only if 

'O 
H' 



H 



where H' is symmetric and {n — d) x (n — d). 

Finally, we conclude that the codimension of the range is 

, ,n(n + l) ^ d{d-l) 
nd — n) = . 



□ 

Lemma 8.2. |CHSY] Ifn > d and {zi, . . . , Zd} is a linearly independent subset 
o/M", then the codimension of 



{©j=i 



HjZ2 



■.H={H,,...,Hg)eSnim}cW^'' 

\HjZd/ 

is (independent of n). 

Finally, the form in which we generally apply the lemma is the following. 

Lemma 8.3. Fix n, v e W, and A E S„(M^') and X G S„(M^'). // the set 
{'m{a,x)v : \m\ < d} (bi-degree of m is at most d, meaning degree at most da 
in a and d^ in x) is linearly independent, then the codimension of 

{V{A,X)[H]v : H e §„,(M^)} 

is at most g '^^'^2^\ where k, = gi and where V is the border vector 

associated to the given collection of monomials. Again, this codimension is 
independent ofn. 

Proof. Let Zm = m{A, X)v for the given collection of monomials m. There are 
at most K of these. Now apply the previous lemma. □ 

9. Appendix: Generic Invertibility 

In this Appendix we give the proof of Lemma 13.31 supplied to us by R. 
Guralnick and L. Small. 

Proof. (1) By a result of Amitsur |A69] [Theorem 1] , Theorem 1) , if g vanishes 
on all symmetric matrices of size m and deg q = d, then all matrices of size m 
satisfy the standard identity S2d, but this bounds the size of the matrices. So 
taking n sufficiently large, p does not vanish on all n x n symmetric matrices. 

(2) Now consider nxn matrices Yi, 1^ with distinct commuting variables 
as entries (called "generic matrices" by some) e.g.., Yi = {yij)i,j=i,.-- ,n and their 
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transposes , ...,Y^ . Consider the algebra these matrices of polynomials 
generate. If n is a power of 2, then this is an integral domain with a quotient 
division ring D contained in the n x n matrices over the field of rational 
functions. See for example, |BS88j . 

(3) To finish the argument: 
take your q and consider q(Yi + , ...,Yg + Yj') for n a sufficiently large power 
of 2 (depending only the degree of q), so q is nonzero (note that since we are in 
characteristic not 2, the Yi + Y^'" are generic symmetric matrices, so q not zero 
means that q does not vanish with those arguments) and q is an element of 
the ring generated by Yi, ■■■Yg, Y^ , ■■■Yj and this is a domain with a quotient 
division ring, it follows that det q{Yi + Y^ , + Yj) is a polynomial which 
is not identically zero. Thus it is nonzero on an open dense set, so the result 
follows. □ 
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